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0.  Abstract. 

\ 

V 

We  address  the  problem  of  finding  a  minimum  weight  base  B  of  a 
matroid  when,  in  addition,  each  element  of  the  matroid  is  colored  with  one  of 
m  colors  and  there  are  upper  and  lower  bound  restrictions  on  the  number  of 
elements  of  B  with  color  i,  for  i  -  l,  2, ....  m.  This  problem  is  a  special 
case  of  matroid  intersection.  W^-prese^t  an  algorithm(tha?exploit^/thec' 
special  structure,  and  w^appty^to  two  optimization  problems  on  graphs. 
When  applied  to  the  weighted  bipartite  matching  problem,  eu^algorithm  has 
complexity  OflE|  |V|  +  |V|2  log  |V|).  Here  V  denotes  the  node  set  of  the 
underlying  bipartite  graph,  and  E  denotes  its  edge  set.  The  second 
application  is  defined  on  a  general  connected  graph  G  =  (V,  E)  whose  edges 
have  a  weight  and  a  color.  6ne  seeks  a  minimum  weight  spanning  tree  with 
upper  and  lower  bound  restrictions  on  the  number  of  edges  with  color  i  in 
the  tree,  for  each  i.  Our  algorithm  for  this  problem  has  complexity 
0(|E|  |V|  +  m2  |V|  +  m  |V$.  A  special  case  of  this  constrained  spanning  tree 
problem  occurs  when  V*  is  a  set  of  pairwise  nonadjacent  nodes  of  G.  One 
must  find  a  minimum  weight  spanning  tree  with  upper  and  lower  bound 
restrictions  on  the  degree  of  each  node  of  V*.  Then  the  complexity  of  our 
algorithm  is  0(1V|  |E|  +  |V*|  |V|2).  Finally,  we  discuss  a  new  relaxation  of  the 
traveling  salesman  problem. 


1.  Introduction. 

Let  E  be  a  finite  set,  M  a  matroid  of  rank  r  defined  on  E,  and 
w:  E  ->  R  a  weight  function.  The  weight  of  a  subset  F  c  E  is  defined  by  - 

on  For 

w(F)  o  I{w(e) :  e  e  F}.  Let  E,,  E^  ...,  Em  be  a  partition  of  E  into  nonempty  ? 
subsets.  To  each  Ej  assign  two  integers  Ij  and  Uj  (lj  <  Uj).  We  address  the  3 
problem  of  finding  a  base  B  of  M  which  will  ^jttA&Uation. 

minimize  w(B)  — /rr  - 

subject  to  - 
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lj  £  |B  n  Ej|  £  Uj  for  i  -  1, 2, ....  m. 

This  problem  is  denoted  by  (P).  Since  a  base  B  cannot  contain  loops,  we 
assume  without  loss  of  generality  that  M  is  loopless. 

It  is  known  that  the  set 

B**{Xc  E:  UIXnEjI^u,.  i-1,2. . m,  |X|  -  r} 

is  the  family  of  bases  of  a  matroid  M',  which  has  rank  r.  Such  a  matroid  is 
called  a  generalized  partition  matroid.  Thus,  (P)  is  the  problem  of  finding  a 
minimum  weight  common  base  of  M  and  M’,  if  one  exists. 

This  problem  has  been  solved  in  polynomial  time  by  Edmonds  ([El]  and 
[E2]).  The  algorithm  presented  here  takes  advantage  of  the  special  structure 
of  the  matroid  M’  and  works  on  an  auxiliary  digraph  with  m  nodes,  instead 
of  the  n  =  |E|  nodes  required  by  the  general  matroid  intersection  algorithms. 
This  leads  to  a  complexity  of  0(r(nc  +  m  log  m)),  where  c  is  the  complexity 
of  circuit  finding.  By  circuit  finding  we  mean  the  following:  Given 
independent  set  I  and  e  e  E  - 1,  list  the  elements  of  the  unique  circuit  in 
Iu{e),  or  show  that  I  u  {e}  is  independent.  This  complexity  is  to  be 
compared  with  the  0(nr(r  +  c  +  log  n))  required  by  the  general  algorithm  (see 
Brezovec,  Cornuejols,  and  Glover  ([BCG])). 

To  make  this  paper  self-contained,  we  state  without  proofs  some  of 
the  results  of  [BCG].  This  is  done  in  Section  2.  The  algorithm  for  solving  (P) 
is  presented  in  Section  3.  We  discuss  its  complexity  in  Section  4  and  some 
variants  of  the  algorithm  and  a  postoptimizing  procedure  in  Section  5. 

Finally,  in  Sections  6  and  7,  we  provide  two  examples  of  how  our 
algorithm  may  be  applied  to  classical  combinatiorial  optimization  problems. 

For  the  weighted  bipartite  matching  problem  on  a  graph  G  =  (V,  E),  we  get  an 
algorithm  of  complexity  0(|V|  |E|  +  |V|2  log  |V|),  which  is  the  best  known  for 
weighted  bipartite  matching  (see  Fredman  and  Tarjan  [FT]).  Note  that  the 
general  matroid  intersection  algorithm  only  gives  a  bound  of  0(|E|  |V|2). 

In  Section  7,  we  consider  the  case  where  M  is  the  graphic  matroid 
associated  with  a  connected  graph  G  =  (V,  E).  In  this  case,  our  algorithm  can 
be  made  to  run  in  time  0(|V|  |E|  +  |V|2  m  +  [V]  m2).  We  also  consider  the 
following  problem.  Let  V*  *  {up  v2, ...,  denote  a  stable  set  of  G  (a  set 


of  pairwise  nonadjacent  nodes).  Let  E,  consist  of  the  edges  incident  with 

node  \)j  for  i-1,2 . m-l.with  Em  containing  all  remaining  edges.  A 

minimum  weight  spanning  tree  of  G  must  be  found  with  the  property  that, 
for  i  *  l,  2, ....  m-1,  the  number  of  edges  incident  with  \)j  belongs  to  the 
interval  [ljt  u;].  This  is  of  complexity  0(|V|  |E|  +  m  |V|2)).  Note  that,  here  as 
well,  the  general  matroid  intersection  algorithm  only  gives  a  bound  of 
0(|E(  |V|2).  If  Ij  =  Uj  ■  2  for  i «  l,  2, ....  m-l,  the  complexity  can  be  further 
reduced  to  0(m(|E|  +  m  |V])  +  |E|  log  |V|),  and  such  degree  restricted  spanning 
trees  can  be  used  to  strengthen  the  l-tree  relaxation  of  Held  and  Karp  for  the 
Traveling  Salesman  Problem.  We  also  show  how  this  relaxation  can  be 
further  strengthened  and  generalized  to  the  case  where  V*  is  not  a  stable 
set. 


2.  Known  results 


Most  of  the  material  in  this  section  can  be  found  in  standard 
references  such  as  [W]  (Proposition  1  below  is  Exercise  2  on  page  15  of  [W]) 
or  [L]  (Theorem  2  below  is  similar  to  Theorem  9.4  of  Chapter  8  in  [L]). 
However,  for  the  purpose  of  this  paper,  we  find  it  more  convenient  to  follow 
the  framework  developed  in  [BCG]. 


Let  M  be  a  matroid  defined  on  the  element  set  E,  and  let  B  be  a  base 
of  M.  Consider  pcB  and  (5'cE-B  such  that  |p|  =  |(J'|.  We  say  that  (p,  p’) 
is  a  B-swap  if  (B  -  p)  u  P'  is  a  base  of  M.  We  call  m(p,  p')  a  matching  if 
it  represents  a  one-to-one  mapping  of  p  onto  p';  m(p,  p’)  is  called  a 
B-matching  if  every  (e,  e')  in  m(P,  p')  is  a  B-swap. 


Proposition  1.  [BCG,  Lemma  2].  Let  B  and  B'  be  two  bases  of  M,  and  let 
p  =  B  -  B’  and  p’  =  B'  -  B.  Then  there  is  at  least  one  B-matching  of  (p,  p'). 
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Consider  two  matroids  Mj  and  M2  defined  on  the  same  finite  element 
set  E,  and  let  ICE  be  a  k-intersection,  that  is,  let  I  be  independent  in 
and  M2  such  that  |I|  =  k.  Let  w:  E  -»  R  be  a  weight  function.  The  problem  of 
finding  a  minimum  weight  k-intersection  is  denoted  (Pk).  To  solve  (Pk), 
define  a  bipartite  auxiliary  digraph  G(I)  as  follows.  The  nodes  of  G(I)  are 
partitioned  into  V  and  V'.  Construct  a  node  in  V  for  each  e  e  I  and  a  node 
in  V'  for  each  e'  €  E  - 1.  For  each  e  e  I,  we  construct  an  arc  (e,  e')  with 
weight  w(e,  e’)  =  w(e’)  -  w{e)  provided  (I  -  {e})  u  {e'}  is  independent  in  Mr 
Similarly,  for  each  e'  €  E  - 1,  we  construct  an  arc  (e\  e)  with  weight 
w(e\  e)  »  0  provided  (I  -  {e})  u  {e'}  is  independent  in  M2. 

Let  C  be  a  directed  cycle  in  G(I).  In  this  paper,  directed  cycles  (or 
dicycles,  for  short)  can  have  repeated  nodes  but  no  repeated  arcs.  We  define 
the  weight  of  a  dicycle  to  be  the  sum  of  the  weights  of  the  arcs  in  the 
dicycle. 

Theorem  1.  [BCG,  Theorem  3],  Assume  I  is  a  k-intersection. 

(i)  I  is  optimal  for  (Pk)  if  and  only  if  there  are  no  negative  weight 
dicycles  in  G(I). 

(ii)  Let  C  be  a  negative  weight  dicycle  in  G(I)  with  no  negative 
weight  dicycle  on  a  subset  of  its  nodes,  and  let  Z  and  Z‘  be  the  nodes  of  C 
in  V  and  V,  respectively.  Then  I'  *  (I  -  Z)  u  Z’  is  a  k-intersection  such 
that  w(l')  <  w(l). 

This  theorem  leads  to  an  algorithm  for  solving  (Pk),  given  an  initial 
k-intersection  I:  use  G(I)  to  find  an  improved  solution;  continue  until  a 
G(I)  is  found  which  has  no  negative  weight  dicycles. 

We  modify  this  technique  to  develop  a  dual  algorithm.  Consider  a  set 
A  of  k  artificial  elements,  where  EnA  =  0.  Let  F»EuA  and  define  two 
matroids  M^F)  and  M2(F)  on  the  element  set  F  as  follows.  For  i  =  l,2, 

I  c  E  and  JcA,  the  set  I  u  J  is  independent  in  Mj(F)  if  and  only  if  I  is 
independent  in  Mj.  The  problem  (Pk)  relative  to  these  new  matroids  is 
denoted  (Pk|  F).  In  order  to  define  (Pk|  F)  completely  we  need  to  assign 


weights  to  the  artificial  elements.  By  giving  them  large  negative  weights, 
we  can  guarantee  that  A  is  an  optimal  k-intersection  for  (Pk|  F). 

Define  the  digraph  Sp(I)  from  G(I)  by  splitting  one  of  the  nodes 
arising  from  an  artificial  element,  say  a  e  A,  into  a  source  node  s  and  a 
destination  node  d.  Let  the  arcs  out  of  s  in  Sp(I)  be  those  out  of  a  in  G(I) 
and  the  arcs  into  d  in  Sp(I)  be  those  into  a  in  G(I).  The  following  result 
provides  the  foundation  for  an  algorithm  to  solve  (Pk). 

Theorem  2.  [BCG,  Theorem  5].  Let  I  be  optimal  for  (Pk|  H),  where 
EcHcF,  and  let  Sp(I)  be  obtained  from  G(I)  by  splitting  an  artificial 
element  a  into  s  and  d. 

(i)  Problem  (Pk|  H  -  a)  has  no  solution  if  and  only  if  there  is  no 
s-d  dipath  in  Sp(I). 

(ii)  Let  P  be  a  minimum  weight  s-d  dipath  such  that  every 

s-d  dipath  defined  on  a  subset  of  its  nodes  has  a  strictly  larger  weight,  and 
let  X  and  X'  be  the  nodes  of  P  in  V  and  V',  respectively,  (s  and  d  both 
give  rise  to  a  in  X.)  Then  r  =  (I-X)uX’  is  optimal  for  (Pk|  H  -  a). 

We  use  this  to  solve  (Pk)  as  follows.  Start  with  H  «  F  and  the  set 
I  =  A.  Construct  G(I)  and  then  Sp(I)  by  splitting  one  node  arising  from  an 
artificial  element  a.  Find  a  minimum  weight  dipath  from  the  resulting 
source  s  to  destination  d,  with  the  added  condition  that  every  s-d  dipath 
on  a  proper  subset  of  its  nodes  has  a  strictly  larger  weight.  Then  the  set  r 
defined  in  Theorem  2(ii)  is  optimal  for  (Pk|  H  -  a).  Repeat  this  process  with 
I'  in  place  of  I  and  H  -  a  in  place  of  H,  until  all  artificial  elements  have 
been  split.  When  this  occurs,  we  have  an  optimal  solution  for  (Pk). 

We  close  this  section  with  a  result  that  will  be  useful  in  the  proof  of 
Theorem  6. 

Theorem  3.  [BCG,  Corollary],  Let  e  e  V  and  e'  e  V’. 

(a)  If  P  is  an  e-e'  dipath  in  Sp(I)  and  (I  -  X)  u  X*  is  a  dependent  set 
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in  M1(  then  there  is  an  e-e*  dipath  P0  in  Sp(I)  such  that  the  intermediate 
nodes  of  P0  constitute  a  proper  subset  of  those  of  P,  and  w(P0)  £  w(P). 

(b)  If  P  is  an  e'-e  dipath  in  Sp(l)  and  (I  - 1)  u  L'  is  a  dependent  set 
in  M2,  then  there  is  an  e'-e  dipath  P0  in  Sp(I)  such  that  the  intermediate 
nodes  of  P0  constitute  a  proper  subset  of  those  of  P,  and  w(P0)  <  w(P). 


3.  The  Algorithm 

In  this  section  we  show  how  to  solve  (P).  We  first  assume  that  a 
feasible  solution  B  is  available. 

For  convenience,  we  index  each  element  of  E  to  identify  the  subset  or 
state  of  the  partition  Ev  ....  Em  to  which  it  belongs.  Thus,  e(  and  fj  are 
elements  of  Ej  and  Ej,  respectively.  Also,  the  symbol  '  is  used  to  denote 
that  an  element  is  not  in  base  B,  so  that  ej  e  B  but  ej'  e  E  -  B. 

We  define  the  state  digraph  of  B,  denoted  S(B),  as  follows.  The 
node  set  is  {vp  v2, ...,  vm},  where  node  Vj  corresponds  to  state  i, 
i  =  1,2, ....  m.  For  each  e^B  we  construct  an  arc  a(ej,  e-)  with  weight 
w(a(ej,  ej'))  =  w(ej')  -  w(ej)  directed  from  node  Vj  to  node  Vj  provided 
(ej,  ep  is  a  B-swap.  We  call  these  the  forward  arcs  of  S(B).  Note  that,  in 
general,  the  digraph  S(B)  can  have  loops  and  parallel  arcs.  For  each 
e-e  E  -  B,  construct  a(ej',  e,)  from  Vj  to  v,,  with  weight  0,  provided 
(B  -  {e,})  u  {ej'}  does  not  violate  the  cardinality  conditions  of  E,  and  Ej.  We 
cal!  these  the  backward  arcs  of  S(B).  Note  that  the  existence  of  a 
backward  arc  from  Vj  to  v,  indicates  that  we  can  exchange  any  element 
e,  e  B  n  E|  for  any  element  ej'  e  (E  -  B)  n  Ej  without  violating  the 
cardinality  conditions  on  B  n  E,  and  B  n  Ej.  All  such  backward  arcs  a(ej’,  e,) 
appear  in  parallel  in  S(B). 

We  could  have  constructed  S(B)  using  G(B),  the  bipartite  auxiliary 
digraph  discussed  in  the  previous  section,  as  follows.  Let  Mj  =  M  and  let  M2 
be  the  matroid  whose  bases  are  elements  of  the  set 
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B*  =  {X  c  E:  Ij  ^  |X  n  EJ  ^  ui(  i-1,2 . m,  |X|  -  r}. 

Construct  G(B)  as  explained  in  Section  2.  Consider,  for  i  -  l,  2 . m,  the 

set  of  nodes  of  G(B)  corresponding  to  Ej  and  identify  this  set  as  the  node 
V,-.  Thus,  each  arc  (eit  e-)  or  (fj',  fj)  of  G(B)  becomes  an  arc  joining  v,-  to 
Vj,  and  this  new  digraph  is  clearly  S(B). 

Lemma  1.  Let  C  be  a  dicycle  of  S(B).  Either  C  is  of  the  form 
{a(ejf  e/),  afe/,  ek), ....  a(e|f  eq'),  a(eq',  es)}  (*) 
or  there  exists  a  dicycle  of  S(B)  of  the  form  (*)  with  the  same  forward  arcs 
as  C  (and,  therefore,  the  same  weight  as  C).  Furthermore,  there  is  a 
one-to-one  correspondence  between  the  dicycles  of  S(B)  having  the  form  (*) 
and  the  dicycles  of  G(B). 

Proof.  There  are  four  ways  in  which  C  could  fail  to  have  the  form  (*):  C 
could  contain,  as  subsequences, 

(i)  consecutive  forward  arcs  {a(ej,  ej),  a(fj,  ek')}, 

(ii)  consecutive  backward  arcs  {a(ej\  ep,  a(fj’,  ek)}, 

(iii)  a  forward-backward  pair  with  different  elements  from  E  -  B, 

{a(eif  ej),  a(f j,  ek)},  or 

(iv)  a  backward-forward  pair  with  different  elements  from  B, 

{3(6/,  fk),  a(ek,  e,’)}. 

In  case  (i)  the  loop  a(ej\  fp  must  be  a  backward  arc  in  S(B)  since  swapping 
these  two  elements  in  B  will  not  change  |BnEj|.  So  replace  the 
consecutive  forward  arcs  in  C  with  {a(ej,  ej),  a  (ej,  ij),  a(fj,  ek’)}.  (Recall 
that  we  only  require  dicycles  to  be  arc-disjoint;  so  loops  are  permitted.) 

Assuming  i,  j,  and  k  to  be  distinct,  the  result  of  the  consecutive 
backward  arcs  in  case  (ii)  is  that  the  cardinality  of  Ej  increases  by  one  in 
(B  -  {ej,  ek})  u  {e/,  fj'},  with  the  cardinality  of  Ek  decreasing  by  one.  Ej 
realizes  no  change  in  cardinality  from  this  subsequence.  Thus,  a(ej\  ek) 
must  be  a  backward  arc  in  S(B),  and  we  can  replace  the  consecutive 
backward  arcs  in  case  (ii)  with  the  single  backward  arc  a(ej\  ek).  Note  that 
the  same  replacement  is  appropriate  if  any  of  the  indices  are  not  distinct. 
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In  case  (iii),  the  backward  arc  a(fj\  ek)  can  be  replaced  with  the 
parallel  arc  a(ej\  ek).  Similarly,  a(ej\  fk)  can  be  replaced  with  a^',  ek)  in 
case  (iv). 

Since  these  steps  (which  result  in  a  dicycle  that  has  the  form  (*))  only 
affect  the  backward  arcs  in  the  dicycle,  the  weight  of  the  dicycle  remains 
unchanged. 

The  second  statement  in  Lemma  t  is  immediate.  // 

Define 

p(C)  -  {©j  e  B  :  a(ej,  &■)  is  a  forward  arc  of  C},  and 
p'(C)  -  [e-  e  E  -  B  :  a(ej,  e{)  is  a  forward  arc  of  C}. 

Theorem  4.  Assume  B  is  feasible  for  (P). 

(i)  B  is  optimal  for  (P)  if  and  only  if  there  are  no  negative  weight 
dicycles  in  S(B). 

(ii)  Let  C  be  a  negative  weight  dicycle  in  S(B)  with  no  negative 
weight  dicycle  D  satisfying  p(D)  c  p(C)  and  p'(D)  c  p'(C).  Then 

B'  =  (B  -  p(C))  vj  p'(C)  is  a  base  such  that  w(B’)  <  w(B). 

Proof.  This  result  follows  directly  from  Lemma  1  and  Theorem  1 .  // 

Theorem  4  shows  the  equivalence  of  solving  (P)  and  finding  negative 
weight  dicycles  in  S(B).  This  gives  the  foundation  for  a  primal  algorithm: 
start  with  a  feasible  B  and  use  S(B)  to  find  an  improved  solution.  Continue 
in  this  manner  until  an  S(B)  is  found  with  no  negative  weight  dicycles. 

We  briefly  discuss  the  complexity  issues  of  this  algorithm:  Firstly, 
one  must  be  able  to  find  a  negative  dicycle  in  S(B)  with  the  required 
property.  Also,  the  number  of  iterations  needed  to  reach  the  optimal  solution 
can  be  relatively  large;  even  though  each  iteration  yields  a  better  solution, 
the  improvement  may  be  slight.  For  these  reasons  the  complexity  is  high, 
and  we  do  not  pursue  our  investigation  of  this  primal  algorithm.  (We  do  note, 
however,  that  this  approach  may  have  merits  in  the  context  of  sensitivity 
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analysis:  Given  an  optimal  solution  for  a  certain  set  of  weights, 
reoptimizing  on  a  perturbed  set  of  weights  using  this  method  may  be  more 
efficient  in  practice  than  starting  from  scratch,  as  other  algorithms  for 
matroid  intersection  would  require.) 

Instead  we  use  these  results  to  develop  a  dual  algorithm.  First,  using 
a  modification  of  the  greedy  algorithm,  we  can  find  an  initial  solution  B0. 

Start  with  B0  =  0  and,  at  each  iteration,  add  an  element  e  e  E  -  B0  to  B0  if 

(i)  B0u{e}  is  independent  in  M, 

(ii)  e  has  the  smallest  weight  of  all  f  e  E  -  B0  satisfying  (i),  and 

(iii)  |(B0  u  {e})  n  EJ  £  Uj  for  i  •  1, 2, ....  m. 

Stop  when  either  no  such  e  can  be  found,  |B0|  =  r,  or,  for  the  e  chosen, 

r  -  |B0  u  {e}|  <  S{max(lj  -  |(B0  u  {e})  n  EJ,  0):  i  =  1, 2 . m} 

(in  which  case  e  should  not  be  added  to  B0).  Violating  this  last  condition 
would  result  in  a  B0  which  could  not  satisfy  both  |B0|  =  r  and  all  lower 
bound  conditions.  At  the  termination  of  this  procedure  we  clearly  have  the 
least  weight  independent  set  with  |B0|  elements. 

Note  that  B0  contains  at  least  one  element.  If  [B0|  =  r,  (P)  is  solved. 
Otherwise,  consider  a  set  A  of  r  -  |B0|  artificial  elements,  where 
E  n  A  =  0.  We  assign  to  each  artificial  element  a  state  as  follows.  Extend 
Ej  by  unioning  max{0, 1,  -  |B0  n  E,|}  artificial  elements.  Then  extend 
E2,  E3, ....  Em  similarly.  Any  remaining  artificial  elements  can  then  be 
unioned  to  any  of  the  states,  as  long  as  the  resulting  states  satisfy 
|(B0  uA)n  EJ  <  u(.  Note  that,  if  this  cannot  be  done,  (P)  is  infeasible. 

Let  F  =  E  u  A  and  define  a  matroid  M(F)  on  the  set  F  as  follows:  for 
I  c  E  and  J  c  A,  I  u  J  is  independent  in  M(F)  if  and  only  if  I  is  independent 
in  M.  The  problem  (P)  relative  to  M(F)  will  be  denoted  (Pj  F);  we  now  wish 
to  find  the  least  weight  independent  subset  B  of  F  such  that 
I,  <  |B  n  EJ  <  Uj,  for  i  >  1, 2 . m,  and  |B|  =»  r. 

To  define  (P|  F)  completely  we  need  to  assign  weights  to  the  artificial 
elements.  We  will  give  large  negative  weights  to  all  artificial  elements. 

Thus,  the  initial  solution  B  •  B0  u  A  win  bo  optima'  for  (P|  F). 
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Define  the  digraph  S*(B)  from  S(B)  by  creating  two  nodes,  a  source 
node  s  and  a  destination  node  d,  from  an  artificial  element,  say  ae  A.  We 
also  allow  s  and  d  to  denote  the  resulting  elements.  Assume  a  was 
assigned  to  E(.  Replace  arcs  of  the  form  a(a,  e^)  in  S(B)  with  arcs  a(s>,  e j) 
in  S*(B),  and  replace  arcs  of  the  form  a(e|\  a)  in  S(B)  with  a(e|',  d)  in 
S*(B). 

Note  that  we  could  have  constructed  S*(B)  by  forming  Sp(B)  from 
G(B),  and  then  shrinking  groups  of  nodes  (excluding  s  and  d)  corresponding 
to  each  of  the  states  into  the  nodes  vlf  v2,  ...,vm.  Thus  the  following  theorem 
is  a  direct  result  of  Theorem  2.  For  any  s-d  dipath  P  in  S*(B),  define 
p(P)  =  {ej  €  B  :  a(e|,  e-)  is  a  forward  arc  of  P},  and 
p'(p)  =  {ej*  e  E  -  B  :  a(ej,  ej)  is  a  forward  arc  of  P}. 

Theorems.  Let  B  be  optimal  for  (P|  H),  where  EcHcF,  and  let  S*(B)  be 
obtained  from  S(B)  by  creating  s  and  d  from  artificial  element  a. 

(i)  Problem  (P|  H  -  a)  has  no  solution  if  and  only  if  there  is  no 
s-d  dipath  in  S*(B). 

(ii)  Let  P  be  a  minimum  weight  s-d  dipath  such  that  every 

s-d  dipath  Q  satisfying  p(Q)  c  p(P)  and  p'(Q)  c  p'(P)  has  a  strictly  larger 
weight.  Then  B'  =  (B  -  p(P))  u  p'(P)  is  optimal  for  (P|  H  -  a). 

Theorem  5  provides  the  foundation  for  our  algorithm.  Start  with  H  =  F 
and  B  =  B0  u  A,  which  is  optimal  for  (P|  F).  Construct  S(B)  and  then  S*(B) 
by  creating  s  and  d  from  artificial  element  a.  Find  a  minimum  weight 
s-d  dipath  P  such  that  every  s-d  dipath  Q  satisfying  P(Q)  c  p(p)  and 
p'(Q)  c  p'(P)  has  a  strictly  larger  weight.  Then  the  set  B'  defined  in 
Theorem  5(ii)  is  optimal  for  (P|  H  -  a).  Repeat  this  process  with  B'  in  place 
of  B  and  H  -  a  in  place  of  H,  until  the  resulting  B'  contains  no  artificial 
elements.  At  this  step,  B'  is  optimal  for  (P). 

The  complexity  of  the  algorithm  depends  on  our  ability  to  find  a 
minimum  weight  s-d  dipath  in  S*(B)  with  the  added  restriction  stated  in 
Theorem  5(ii).  We  concentrate  on  this  issue  in  the  next  section. 


4.  Complexity  of  the  Algorithm. 


Note  that  the  arc  weights  of  S(B0  u  A)  are  all  nonnegative.  To  see 
this,  first  consider  arcs  of  the  form  a(a,  e-),  where  a  is  artificial.  Since 
w(a)  has  been  chosen  small  enough,  w(a(a,  ep)  =  w(ep  -  w(a)  >  0.  Now 
consider  an  arc  a(ej,  ep,  where  ejS  B0.  Since  this  arc  is  in  S(B0uA),we 
have  (B0  -  {e,})  u  {ep  independent  in  M.  But  then  w(ej)  £  w(ep  by 
requirements  (i)  and  (ii)  of  our  modified  greedy  approach  in  the  construction 
of  B0;  so  w(a(ej,  e-))  >  0.  Finally,  when  e  is  not  in  B0  u  A,  w(a(e,  f))  =  0. 

All  arc  weights  nonnegative  in  S(B0  u  A)  implies  the  same  for 
S*(B0  u  A);  so  no  minimum  weight  s-d  dipath  will  repeat  nodes.  Thus,  for 
all  pairs  of  nodes,  we  only  need  to  consider  the  arc  of  minimum  weight 
joining  Vj  to  v^  when  searching  for  the  minimum  weight  s-d  dipath,  and  we 
can  apply  Dijkstra's  algorithm  to  find  such  an  s-d  dipath  P.  Furthermore, 
the  requirement  that  every  s-d  dipath  Q  satisfying  p(Q)  c  p(p)  and 
P'(Q)  c  p'(P)  has  a  strictly  larger  weight  can  be  obtained  by  adding  a  small 
positive  e  to  all  the  arc  weights  of  S*(B0uA). 

We  now  show  that  nonnegative  weights  on  the  arcs  of  S(B)  can  be 
preserved  throughout  the  algorithm.  Define  a  variable  D(Vj)  associated  with 
every  node  of  the  digraph  S*(B)  and  a  reduced  weight 
w'(a(ej,  ep)  =  w(a(ej,  ep)  +  D(Vj)  -  D(vp 
associated  with  each  forward  arc  of  S(B).  Similarly,  for  each  backward  arc 
define 

w'(a(ek\  e,))  =  D(vk)  -  D(v,). 

Note  that,  in  terms  of  the  reduced  weights,  the  length  of  an  s-d  dipath  P  is 
w'(P)  =  w(P)  +  D(s)  -  D(d)  since,  for  any  intermediate  node  vjt  the  variable 
D(Vj)  cancels  out  on  the  two  arcs  of  P  that  contain  Vj.  Since  D(s)  -  D(d)  is 
a  constant  that  does  not  depend  on  P,  it  is  equivalent  to  solve  the  minimum 
weight  s-d  dipath  problem  in  S*(B)  with  the  reduced  weights  w'  instead 
of  the  original  weights  w.  We  provide  a  choice  for  the  variables  D(V|)  that 
guarantees  nonnegative  reduced  weights  from  one  iteration  to  another  in  the 
next  theorem. 


Theorem  6.  Let  B  be  optimal  for  (P|  H)  where  EcHcF,  and  assume  that 
an  s-d  dipath  exists  in  S*(B).  Set  D(Vj)  to  be  the  weight  of  a  minimum 

weight  s-Vj  dipath  in  S*(B),  for  i  =  1, 2 . m.  If  there  is  no  s-Vj  dipath,  set 

D(Vj)  =  M,  where  M  is  some  large  constant.  Let  B'  be  as  defined  in 
Theorem  5(ii).  Then,  the  reduced  weights  w'(a(ek\  e,))  =  D(vk)  -  D(V|)  and 
w'(a(ej,  ep)  =  w(a(e|,  ep)  +  D(Vj)  -  D(vp  are  nonnegative  for  every  backward 
arc  a(ek',  e,)  and  every  forward  arc  a(ej,  ep  of  the  digraph  S(B')  for 
problem  (P|  H  -  a). 

Using  the  same  argument  as  in  Lemma  1 ,  we  can  show  that,  for  every 
s-d  dipath  P  in  S*(B)  which  does  not  have  the  form 

{a(s,  ep,  a(ei',  ep,  a(ejt  ek') . a(e,\  d)},  (**) 

there  is  an  s-d  dipath  of  the  form  (**)  with  the  same  forward  arcs  and, 
hence,  the  same  weight  as  P. 

For  the  proof  of  Theorem  6  we  need  the  following  proposition,  which  is 
a  direct  result  of  Theorem  3.  We  also  need  to  extend  the  definitions  of  (5(P) 
and  p'(P)  to  u-v  dipaths  P,  where  u  and  v  are  general  nodes  of  S*(B): 
p(P)  -  {ej  e  B  :  a^,  ep  is  a  forward  arc  of  P, 

or  a(ek',  ep  is  the  last  arc  of  P},  and 
p'(P)  -  {ep  €  E  -  B  :  a(e|,  ep  is  a  forward  arc  of  P, 

or  a(ep  ek)  is  the  first  arc  of  P}. 

Proposition  2.  Let  P  be  a  minimum  weight  s-d  dipath  in  S*(B)  such  that 
every  s-d  dipath  Q  satisfying  p(Q)  c  p(P)  and  p'(Q)  c  p’(P)  has  a  strictly 
larger  weight  than  P,  and  let  P0  be  some  subpath  of  P. 

(a)  If  the  first  and  last  arcs  on  P0  are  forward  arcs,  then 
[B  -  P(P0)]  u  P'(P0)  is  independent  in  M. 

(b)  If  the  first  and  last  arcs  on  P0  are  backward  arcs,  then 
[B  -  P(P0)]  u  p'(P0)  satisfies  the  cardinality  conditions  on  each  Ej. 

Proof  of  Theorem  6.  First  we  show  that  the  choice  for  D(vp  gives 
nonnegative  reduced  weights  on  the  arcs  of  S(B).  Consider  a(e|,  ep  in  S(B), 
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and  suppose  w(a(ejt  e-))  +  D(Vj)  -  D(Vj)  <  0.  This  gives 
D(Vj)  +  w(a(e,f  e-))  <  D(Vj), 

which  implies  that  the  minimum  weight  s-Vj  dipath  together  with  the  arc 
a(ej,  ep  gives  a  smaller  weight  from  s  to  Vj  than  D(V|),  a  contradiction. 
Similarly,  for  each  backward  arc  a(fj',  fj)  in  S(B), 
w(a(fj',  fj))  +  D(Vj)  -  D(Vj)  >  0.  Thus,  our  choice  of  D(Vj)  gives  nonnegative 
reduced  weights  on  the  arcs  of  S(B). 

Let  P  be  the  minimum  weight  s-d  dipath  that  yields  B'  in 
Theorem  5(ii),  and  let  Pj  be  the  subpath  of  P  from  s  to  some  node  v(.  Let 
Pj(i)  and  (^'(i)  be  the  sets  of  elements  of  B  and  E  -  B,  respectively, 
represented  by  the  forward  arcs  of  Pj(  and  let  p2(i)  and  p2'(i)  be  the 
corresponding  sets  of  elements  represented  by  the  backward  arcs  of  Pj.  By 
Proposition  2,  Bj(i)  =  B  -  pt(i)  +  Pj’(i)  is  independent  in  M,  and 
B2(i)  =  B  -  p2(i)  +  p2’(i)  satisfies  the  cardinality  conditions  on  each  Ej.  For 
ease  of  notation  we  allow  Vj  to  represent  s  and  d,  as  well  as  the  nodes 
representing  states  Ev  E2 . Em. 

We  construct  a  digraph  Nj  as  follows.  The  node  set  of  Nj  is  that  of 
S(B).  If  Bj(i)  -  ^  +  ek'  is  independent  in  M,  then  a(ej,  ek')  is  a  forward  arc 
of  N,-;  if  B2(i)  -  ^  +  ek'  satisfies  the  cardinality  conditions  of  each  E,-,  then 
a(ek\  ej)  is  a  backward  arc  of  Nj.  Note  that,  in  the  latter  case,  we  call 
(ek\  ej)  a  B2(i)-swap  with  respect  to  the  partition  matroid. 

We  will  show  that  this  choice  of  D(Vj)  gives  nonnegative  reduced 
weights  on  the  arcs  of  Nj  by  induction  on  the  nodes  of  P,  starting  from 
^  =  s.  Note  that  when  we  reach  Vj  =  d,  we  will  have  Nj  =  S(B')  for  (P|  H  -  a), 
and  the  theorem  will  be  proved. 

When  Vj  =  s,  Nj  =  S(B),  and  the  result  has  been  proved  above.  Let  ^  be 
a  node  of  P  for  which  the  result  holds,  and  let  Vj  be  the  node  following  vf 
in  P.  There  are  two  cases  to  consider,  as  the  arc  joining  v;  to  Vj  can  be  a 
forward  arc  or  a  backward  arc. 

Suppose  the  arc  joining  Vj  to  Vj  in  P  is  a  forward  arc  a(ej,  ej’).  In 
this  case  the  backward  arcs  of  Nj  are  the  same  as  those  of  Nj;  hence,  they 
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have  nonnegative  reduced  weights  by  induction.  Thus,  we  only  need  to  show 
D(vq)  -  D(vp)  <  w(eq')  -  w(ep)  for  every  B^-swap  (ep,  eq').  Note  that  if 
(ep)  eq')  is  also  a  Bj(i)-swap  we  are  done.  So  only  consider  Bj(j)-swaps 
which  are  not  B^iJ-swaps. 

If  (ep,  eq')  =  (ef,  es),  then 

D(Vj)  -  D(Vj)  +  w(ep  -  w(6j)  (t) 

since  a(ej,  ej')  is  on  the  minimum  weight  s-d  dipath  P,  and  the  desired 
inequality  is  immediate. 

For  the  remaining  cases,  consider  B*  =  Bj(i)  -  ^  +  e^  -  ep  +  eq\  which 
is  independent  in  M.  Suppose  ep  -  ej'  and  eq'  *  e{.  Then  B*  =  By{\)  -  e{  +  eq’ 
and  (e^  eq')  is  a  Bj(i)-swap.  Therefore,  w(eq')  -  w(ej)  +  D(Vj)  -  D(vq)  >  0  by 
induction.  Combining  this  inequality  with  (t)  and  ep  =  ej',  we  get 
w(eq)  -  w(ep)  +  D(vp)  -  D(vq)  >  0,  and  the  result  follows.  A  similar  argument 
applies  when  ep  *  e-  and  eq'  =  ej. 

Finally,  suppose  ep  *  ej'  and  eq’  *  ej.  Since  (ep,  eq')  is  not  a 
B,(i)-swap,  yet  B*  is  a  base,  it  follows  from  Proposition  1  that  both 
(ep,ej')  and  (ejt  eq')  are  B,(i)-swaps.  Thus,  w(ep  -  w(ep)  +  D(vp)  -  D(Vj)  >  o, 
and  w(eq')  -  w(ej)  +  D(ej)  -  D(eq)  1 0.  Summing  these  inequalities  and  applying 
(t).  we  get  w(eq’)  -  w(ep)  +  D(vp)  -  D(vq)  >  0. 

Now  suppose  the  arc  joining  Vj  to  Vj  in  P  is  a  backward  arc  a(fj',  fj). 
Then  Bj(j)  =  B^i),  and  the  forward  arcs  of  Nj  are  the  same  as  those  of  Nj. 
Hence,  they  have  nonnegative  reduced  weights  by  induction.  Thus,  we  only 
need  to  show  D(vp)  -  D(vq)  >  0  for  every  B2(j)-swap  (ep',  eq).  Note  that  if 
(ep’,  eq)  is  also  a  B2(i)-swap  we  are  done  by  induction.  So  only  consider 
B2(j)-swaps  which  are  not  B2(i)-swaps. 

If  (Op*.  eq)  =  (fj,  fj'),  then 
D(vp  =  D(v,)  (ft) 

since  a(fj\  f,)  is  on  the  minimum  weight  s-d  dipath  P,  and  the  desired 
inequality  is  immediate. 

For  the  remaining  cases  consider  B**  =  B2(i)  -  fj  +  ff  -  eq  +  ep\  which 
satisfies  the  cardinality  conditions  for  each  E,  since  (ep\  eq)  is  a 
B2(j)-swap.  Suppose  ep'  -  fj  and  eq  *  fj'.  Then  B**  =  B2(i)  -  eq  +  fj',  and 
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(f/,  eq)  is  a  B2(i)-swap.  Hence,  Dty)  -  D(vq)  >  0  by  induction.  This  and 
equation  (tt)  show  that  D(vp)  -  D(vq).  The  proof  is  similar  when  ep'  *  fj  and 
eq  =  fj . 

Finally,  suppose  ep’  *  fj  and  eq  *  fj'.  Since  (ep\  eq)  is  not  a 
B2(i)-swap,  yet  B**  is  independent  in  the  partition  matroid,  it  follows  from 
Proposition  1  that  both  (ep',  fj)  and  (fj1,  eq)  are  B2(i)-swaps.  Thus, 
induction  yields  D(vp)  -  D(Vj)  >  0  and  D(Vj)  -  D(vq)  >  0.  Summing  these 
inequalities  and  applying  (tt),  we  get  D(vp)  -  D(vq)  >  0.  // 

We  now  summarize  the  complexity  of  the  algorithm.  O(r)  iterations 
will  be  needed,  one  iteration  for  the  removal  of  each  artificial  element  in 
the  initial  solution.  In  each  iteration  we  need  to  construct  S(B),  find  a 
minimum  weight  s-d  dipath,  and  update  the  variables  D(Vj).  Recall  that 
|E|  *  n,  and  c  represents  the  time  required  to  find  the  circuit  of  I  u  {©'}  in 
M  (or  show  that  none  exists),  where  ICE  is  independent  and  e' e  E-I. 

To  construct  S(B)  for  the  problem  (P|  H),  EcHcF,  we  solve  the 
following  circuit  recognition  problem  for  each  e'  e  H  -  B:  Check  whether 
Bu(e')  is  dependent  in  M(H),  and,  if  it  is,  find  the  unique  circuit  of  Bu{e'}. 
This  task  requires  time  c  for  each  e*  e  H  -  B.  So  the  complexity  of 
constructing  S(B)  is  O(nc).  In  some  instances  it  is  possible  to  speed  up  the 
construction  of  S(B),  as  not  all  parallel  arcs  need  to  be  constructed,  but  only 
the  shortest.  An  example  of  this  will  be  given  in  Section  7. 

Using  the  fast  implementation  of  Fredman  and  Tarjan  (see  [FT]),  the 
complexity  of  finding  a  minimum  weight  s-d  dipath  by  Dijkstra’s  algorithm 
is  at  most  0(p  +  m  log  m),  where  p  is  the  cardinality  of  the  set  of  arcs  in 
S(B). 

Note  that  the  variables  D(Vj)  needed  in  Theorem  6  are  actually 
computed  in  the  course  of  finding  a  shortest  s-d  dipath.  Thus,  no  extra 
computations  are  needed.  Also,  nc  is  larger  than  p.  Therefore,  the  overall 
complexity  of  the  algorithm  is  0(r(nc  +  m  log  m)). 


5.  Improved  Starting  Solution  and  Variants  of  the  Algorithm. 

In  this  section  we  provide  two  variants  of  our  algorithm.  Although 
they  do  not  improve  our  complexity  bounds,  they  may  yield  a  more  successful 
implementation.  Let  B'  be  a  minimum  weight  base  of  M,  found  using  the 
greedy  algorithm.  Both  variants  use  B'  to  obtain  a  full  starting  base  B 
instead  of  the  initial  solution  B0  to  which  artificials  are  appended. 

In  the  first  variant  we  make  copies  of  selected  elements  of  B*  which 
replace  their  counterparts,  thereby  producing  a  base  B  that  is  feasible  for 
(P)  relative  to  an  extended  matroid.  The  copies,  labeled  artificial  elements, 
are  assigned  to  the  sets  Elt  E2, ....  Em  by  the  following  rules  so  that  the 
cardinality  restrictions  are  satisfied. 

Initialize  with  B  =»  B'.  For  any  pair  {i,  j}  such  that  lj  >  |B  n  EJ  and 
Uj  <  |B  n  Ej|,  define  a(  to  be  a  copy  of  6j,  the  maximum  weight  element  in 
BnEj.  Assign  the  artificial  element  otj  to  Ej  with  w(<Xj)  ■  w(ep,  and 
replace  B  with  (B  -  {e^)  u  {<Xj}.  Extend  M  so  that  I  u  {a}  is  independent  in 
the  extended  matroid  if  and  only  if  I  u  {ej}  is  independent  in  M. 

Once  no  more  pairs  {i,  j}  of  this  form  exist,  select  a  pair  such  that 
lj  >  |B  n  Ej|  and  lj  <  |B  n  Ej|  or  such  that  Uj  >  |B  n  Ej|  and  Uj  <  |B  n  Ej|.  (If  none 
remain,  all  cardinality  constraints  are  satisfied,  or  (P)  has  no  feasible 
solution.)  Then  create  the  artificial  element  as  and  change  B  and  M  as 
above. 

One  advantage  of  this  variant  is  that,  in  the  process  of  eliminating  an 
artificial  element  by  solving  a  minimum  weight  s-d  dipath  problem,  it  is 
possible  that  one  or  more  other  artificials  may  leave  B,  in  which  case  they 
can  be  dropped  from  the  problem  and  disregarded  thereafter.  Thus,  fewer 
state  digraphs  may  be  needed  to  eliminate  the  artificial  elements.  A  simple 
version  of  this  variant,  one  in  which  all  artificial  elements  are  assigned  the 
same  weight,  is  used  in  Section  7  for  the  special  case  in  which  M  is  a 
graphic  matroid. 
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The  second  variant  replaces  the  bounds  for  the  cardinality  constraints 
by  relaxed  bounds  that  are  progressively  tightened  until  the  original  bounds 
are  achieved.  Begin  with  the  base  B  =  B\  and,  for  each  B  subsequently 
generated,  define  u/  =  maxfu,,  |B  n  Ej|}  and  Ij'  =  min{lj,  |B  n  Ej|}.  Once  uf  =  u-, 
and  Ij*  -  I,-  for  i  -  l,  2, ...,  m,  problem  (P)  is  solved.  Otherwise,  identify  a 
pair  {i,  j}  by  the  rules  of  the  preceeding  variant  and  create  a  single 
artificial  to  replace  an  element  ej  e  B,  thus  increasing  If  by  1  or 
decreasing  uf  by  1,  or  both.  Then  eliminate  otj  by  solving  a  minimum 
weight  s-d  dipath  problem  and  repeat.  A  noteworthy  feature  of  this  variant 
is  that  B  never  contains  an  artificial  element  except  as  a  device  for 
creating  an  appropriately  defined  minimum  weight  dipath  problem. 


Our  results  lead  to  another  postoptimization  procedure,  in  addition  to 
that  given  by  Theorem  4,  for  finding  a  new  optimal  solution  when  element 
weights  are  perturbed.  The  basic  steps  of  this  postoptimizing  method  are  as 
follows.  Of  the  elements  with  new  weights,  first  consider  only  those  in  the 
set  R  defined  to  consist  of:  (1)  elements  in  B  whose  weights  are 
decreased,  and  (2)  elements  not  in  B  whose  weights  are  increased.  The 
problem  in  which  only  the  elements  of  R  receive  their  new  weights  is  still 
solved  optimally  by  the  current  solution.  Correspondingly,  update  the 
distances  D(Vj)  for  the  minimum  weight  dipath  tree  created  at  the  last 
iteration  of  solving  (P). 

Now  consider  one  at  a  time  each  remaining  element  whose  weight  is  to 
be  changed.  If  the  element  is  in  B,  solve  the  minimum  weight  dipath  problem 
that  treats  this  element  precisely  as  if  it  were  an  artificial  element  with 
the  new  given  weight.  If  the  element  is  not  in  B,  determine  the  effect  of 
forcing  it  to  become  part  of  B  by  solving  an  analogously  defined  minimum 
weight  dipath  problem:  Let  ej'  denote  the  element  under  consideration. 
Replace  arcs  of  the  form  a(ej',  ej)  in  S(B)  with  arcs  a(s,  e)  in  S*(B),  and 
replace  arcs  of  the  form  a(e:,  ej')  in  S(B)  with  arcs  a(ejt  d)  in  S*(B). 
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Our  previous  results  hold  for  both  cases,  and,  hence  reduced  arc 
weights  obtained  after  the  minimum  weight  dipath  problem  has  been  solved, 
and  B  is  changed,  will  remain  nonnegative.  Thus,  upon  giving  the  element 
its  new  weight,  if  the  resulting  solution  has  a  smaller  weight  than  B,  the 
new  solution  is  kept.  However,  if  the  there  is  no  improvement,  or  if  no 
s-d  dipath  exists,  B  is  unchanged. 

It  is,  of  course,  unnecessary  to  solve  the  minimum  weight  dipath 
problem  if,  on  tentatively  assigning  an  element  its  new  weight,  the  reduced 
weights  for  all  arcs  associated  with  the  element  are  nonpositive  when  the 
element  is  in  B  and  nonnegative  when  the  element  is  not  in  B.  In  addition, 
when  the  current  base  B  is  replaced  with  a  new  one,  some  elements  not  yet 
assigned  their  new  weights  may  enter  or  leave  B.  These  may  automatically 
be  given  their  new  weights,  since  they  correspond  to  elements  of  R  for  the 
current  iteration.  As  this  occurs,  minimum  weight  dipath  distances  are 
updated  accordingly  in  the  minimum  weight  dipath  tree. 

This  process  solves  at  most  one  minimum  weight  dipath  problem  for 
each  element  whose  weight  changes  (excluding  those  in  the  original  and 
subsequent  sets  R).  Hence,  the  work  is  at  most  0(nc  +  m  log  m)  for  each 
perturbed  weight;  so  we  have  an  efficient  postoptimizing  procedure  when 
the  number  of  such  elements  is  small. 


6.  Weighted  bipartite  matching. 

Consider  a  graph  G  =  (V,  E)  and  a  weight  function  w:  E  ->  R.  The 
matching  problem  consists  of  finding  a  minimum  weight  subset  F  c  E  such 
that  each  node  of  V  is  incident  with  exactly  one  member  of  F.  In  this 
section  we  assume  that  G  is  a  bipartite  graph  where  the  partition 
Vj  u  V2  -  V  is  such  that  |Vt|  »  |V2|.  The  weighted  bipartite  matching 
problem,  also  called  the  assignment  problem,  is  a  special  instance  of 
problem  (P)  where  the  partition  of  E  is  induced  by  the  nodes  of  V2. 
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Specifically,  e  e  Es  if  and  only  if  it  is  incident  with  node  v(-  e  V2.  For  each 
i,  lj  *  Uj  ■  1.  The  matroid  M  is  also  a  partition  matroid,  namely  the  one 
induced  by  the  node  set  Vj. 

For  this  problem  r  =  |V|/2,  n  =  |E|,  and  m  =  |V|/2.  To  obtain  the 
complexity  of  our  algorithm  for  this  problem,  we  have  to  determine  the 
complexity  of  constructing  S(B).  Note  that  the  circuits  of  M  have  length  2; 
so  the  number  of  forward  arcs  of  S(B)  is  at  most  |E|.  Similarly,  there  are  at 
most  |E|  backward  arcs. 

Thus,  the  construction  of  S(B)  requires  time  0(|E|).  Since  the 
Fredman  Tarjan  algorithm  finds  the  minimum  weight  dipath  in  time 
0(|E|  +  |V|  log  |V|),  the  overall  complexity  is  0(|V|  |E|  +  |V|2  log  1V|). 

Note  that  our  algorithm  is  closely  related  to  the  usual  augmenting  path 
algorithm.  Although  this  algorithm  and  the  associated  bound  are  not  new,  it 
is  interesting  that  they  are  obtained  using  the  state  digraph  approach.  Recall 
that  the  general  matroid  intersection  algorithm  only  gives  the  bound 

0(|V|2  |E|). 


7.  Minimum  spanning  trees. 

Let  G  (V,  E)  be  a  connected  graph,  with  E,,  E2 . Em  a  general 

partition  of  the  edge  set,  and  let  each  edge  of  G  be  assigned  a  weight.  For 

i  =  1, 2 . m  assign  two  integers  I,  and  uj(  where  Ij^Uj.  In  this  section,  we 

consider  the  problem  of  finding  a  minimum  weight  spanning  tree  B  c  E  with 
the  restriction  that  lj  <  |B  n  EJ  <  ujf  for  i  «  1,2, ...,  m.  The  minimum  spanning 
tree  problem  with  restrictions  on  the  number  of  edges  in  each  Ej  is  an 
instance  of  (P):  M  is  the  graphic  matroid  defined  on  the  edge  set  E,  and  the 
generalized  partition  matroid  is  induced  by  the  partition  of  E.  We  will  refer 
to  Ej,  E2, ...,  Em  as  the  m  color  classes. 
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An  interesting  feature  of  this  instance  is  that,  by  using  the  special 
structure  of  the  tree,  we  do  not  need  to  construct  the  entire  state  graph 
S(B).  However,  our  method  requires  that  we  work  with  spanning  trees.  So, 
instead  of  simply  extending  the  graphic  matroid  M  to  M(F)  as  described  in 
Section  3,  create  an  artificial  edge  in  G  for  each  artificial  element  so  that 
the  resulting  first  solution,  B0  u  A,  is  a  spanning  tree  in  the  extended  graph 
G*  =  (V,Eu  A).  This  is  an  application  of  our  first  variant  in  Section  5. 

We  now  outline  a  procedure  for  constructing  the  state  graph  S(B).  For 
each  color  i,  label  each  e  €  B  with  the  edge  f  e  E  -  B  of  color  i  that  gives 
the  smallest  weight  B-swap  (e,  f).  Thus,  we  will  find  the  minimum  weight 
arc  in  S(B)  from  Vj  to  Vj  for  each  pair  (vi(  vp  of  states. 

Begin  by  sorting  the  edges  in  each  color  class  in  ascending  order  by 
weight.  At  worst,  this  work  is  0(|E|  log  | Vj).  Note  that  we  need  to  sort  the 
edge  weights  only  once  since  the  reduced  weights  only  add  a  constant  to  all 
the  edges  in  the  same  color  class.  At  each  iteration  of  our  algorithm,  in  the 
construction  of  each  new  state  graph,  proceed  as  follows: 

1 .  Set  up  (or  update)  the  current  tree  B  with  an  arbitrary  root  and 
predecessor  indexing. 

2.  For  i  =  1,2, ...,  m,  start  with  all  edges  in  B  unlabeled.  Examine  the  edges 
f  =  (x,  y)  of  color  i  in  E  -  B  in  ascending  weight  order.  Find  the  first 
common  ancestor  of  x  and  y  in  B,  and  label  each  unlabeled  edge  of  B  in 
the  cycle  of  Bu  {f}  with  f.  Stop  the  labeling  procedure  for  color  i  when 
either  all  tree  edges  have  been  labeled,  or  all  edges  of  color  i  in  E  -  B  have 
been  examined. 

Since  we  examine  the  edges  of  color  i  in  E  -  B  in  ascending  weight 
order,  each  edge  of  B  will  be  labeled  with  the  edge  of  E  -  B  which  results 
in  the  least  weight  B-swap.  Using  the  set  merging  technique  of  Gabow  and 
Tarjan  (see  [GT2]),  0(|Ej|  +  |V|)  work  is  required  for  this  labeling  procedure 
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for  each  color.  So  the  complexity  of  the  construction  of  each  state  graph  is 
0(|E|  +  m  |V|).  The  complexity  due  to  the  Fredman-Tarjan  minimum  weight 
dipath  algorithm  is  at  most  0(m2),  and  the  graphic  matroid  has  rank  at  most 
|V|  - 1.  Hence,  the  overall  complexity  is  0(|V|  m2  +  |V|  |EJ  +  m  |V|2).  Note  that 
the  0(|E|  log  |V|)  work  required  for  sorting  the  elements  in  each  color  class 
is  dominated  by  this  complexity. 

We  note  that,  for  small  values  of  m,  much  faster  algorithms  are 
known.  For  m  =  1,  the  problem  is  nothing  but  the  classical  minimum 
spanning  tree  problem,  and  there  is  an  algorithm  of  complexity 
0(|E|  log  log  |V|)  due  to  Vao  ([Y]).  More  recent  developments  can  be  found  in 
[GGST1-  For  m  =  2,  the  bound  O(o  +  |V|  log  |Vj)  has  been  achieved  by  Gabow 
and  Tarjan  ([GT1]),  where  o  denotes  the  complexity  of  finding  a  minimum 
spanning  tree. 


Let  V*  =  {uj,-u2, ....  be  a  stable  set  of  G;  that  is,  no  edge  of  E 

has  both  endpoints  in  V*.  For  i «  1, 2 . m-l,  let  Ej  denote  the  set  of  edges 

which  are  incident  with  node  u(  in  G,  and  let  Em  be  the  set  of  remaining 
edges.  In  this  case  the  0{m2)  due  to  the  Fredman-Tarjan  minimum  weight 
dipath  algorithm  is  dominated  by  the  complexity  of  constructing  the  state 
graph.  Hence,  the  overall  complexity  is  0(|V|  |E|  +  m  |V|2). 

In  the  special  stable  set  case  where  lj  =  Uj  =  2  for  i  **  1, 2, ....  m-l,  and 
lm  =  0  and  um  e  |V|  -  2m  +  1,  the  greedy  phase  of  finding  a  starting  solution 
B0  can  substantially  reduce  the  number  of  iterations  needed.  For 
i  =  1,2, ....  m-l,  add  a  constant  Cj  to  the  weights  of  the  edges  incident  with 
node  u,  e  V*.  We  assign  large  enough  values  to  the  constants  so  that  the 
greedy  phase  will  first  choose  |V|  -  2m  +  1  edges  in  Em  to  construct  the 
spanning  tree.  Let  w  be  the  weight  of  the  last  edge  added.  For 

i  -  1, 2 . m-l,  we  adjust  the  constant  Cj  so  that  the  minimum  weight  edge 

incident  with  v>j  has  weight  w  and,  therefore,  can  be  chosen  next  in  the 
greedy  phase. 


This  extended  greedy  solution  B0  contains  |V|  -  m  edges,  so  only 
m  - 1  artificial  elements  are  needed.  They  can  be  chosen  so  that  B0  vj  A  is  a 
tree  having  degree  2  at  each  of  the  nodes  of  V\  Furthermore,  if  the 
weights  of  the  artificial  elements  are  chosen  small  enough,  B0  u  A  is  an 
optimum  solution  of  (P|  EuA)  and,  therefore,  a  valid  start  for  our  dual 
algorithm.  Hence,  only  m  - 1  iterations  of  the  algorithm  are  needed.  This 
yields  an  algorithm  of  complexity  0(m(|E|  +  m  |V|)  +  |E|  log  |V|).  (Note  that  the 
sorting-time  complexity  is  not  dominated  in  this  case.) 

In  this  case  (P)  is  the  problem  of  finding  the  minimum  weight  spanning 
tree  in  G  such  that  every  node  in  V*  is  adjacent  to  exactly  two  edges  of 
the  tree.  Such  a  spanning  tree  is  a  relaxation  of  a  hamiltonian  path,  namely, 
a  simple  path  which  contains  each  node  of  G. 

Consider  the  following  variant  of  spanning  trees.  A  l-tree  is  a  graph 

with  nodes  {l,  2, ...,  |V|}  consisting  of  a  spanning  tree  on  {2, 3 . |V|} 

together  with  two  edges  incident  with  node  1.  The  traveling  salesman 
problem  on  G»  (V,  E)  seeks  a  minimum  weight  tour,  a  cycle  which  passes 
through  each  node  exactly  once.  Observing  that  a  tour  is  precisely  a  l-tree 
in  which  each  node  has  degree  2,  Held  and  Karp  explored  approaches  to  the 
traveling  salesman  problem  which  involve  l-tree  relaxations  (see  [HK1]  and 
[HK2]). 

Our  technique  permits  a  generalization  of  Held  and  Karp's  method  to 
yield  a  constrained  l-tree  as  follows.  Suppose  the  nodes  are  indexed  so  that 

{1, 2, ....  m-l}  is  a  stable  set  of  G,  and  let  V*  =  {2, 3 . m-l).  Then,  instead 

of  using  a  general  spanning  tree  on  {2, 3, ....  |V|},  find  a  minimum  weight 
spanning  tree  such  that  every  node  in  V*  has  degree  2.  Add  the  two  edges 
incident  with  node  1  of  minimum  weight.  Clearly,  this  constrained  l-tree 
is  still  a  relaxation  of  a  minimum  weight  tour.  It  is  tighter  than  the  l-tree 
relaxation,  which  is  obtained  when  V*  =  0.  Recently,  however,  [LR]  have 
shown  that  the  lagrangian  duals  based  on  these  two  relaxations  have  the 
same  value.  Next,  we  consider  a  further  strengthening  of  the  l-tree 
relaxation. 
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Define  the  star  of  a  node  to  be  the  set  of  edges  incident  with  that 
node.  Suppose  the  nodes  are  ordered  from  1  to  |V|.  For  node  l  define  its 
net  star  to  be  its  star.  Then,  for  i  =  2, 3, ....  |V|,  define  the  net  star  of  node 
i  to  be  its  star,  excluding  edges  which  appear  in  the  stars  of  nodes 
1.2 . i-1. 

Consider  the  following  constrained  spanning  tree  problem.  For  each 
node  i,  let  rx  be  the  number  of  edges  deleted  from  its  star  to  create  its  net 

star.  Then  we  can  stipulate  that  the  spanning  tree  on  {2, 3 . |V|}  must 

contain  at  least  max{0,  2  -  rf}  and  at  most  2  edges  from  the  net  star  of  each 

node  i  >  2.  When  {1,2 . m-l}  is  a  stable  set  of  G,  as  we  assumed  earlier, 

this  procedure  introduces  additional  constraints  to  the  requirement  that 
every  node  in  V*  has  degree  2.  This  is  a  valid  relaxation  of  the  traveling 
salesman  problem  even  if  {l,  2, ....  m-l}  is  not  a  stable  set.  The  cardinality 

restriction  on  the  net  stars  can  be  imposed  on  all  the  nodes  {2,  3 . |V|}  or 

simply  on  a  subset,  say  {2,  3, ....  m-l}.  The  complexity  of  the  algorithm  in 
this  case  is  still  0(|V|  |E|  +  m  |V|2). 

There  may  be  merit  in  choosing  net  stars  adaptively,  in  succession. 

Consider  first  solving  the  spanning  tree  problem,  selecting  as  node  2  one 
whose  net  star  constraint  is  violated,  and  then  solving  (P)  as  if  Ej  and  its 
complement  are  the  only  two  sets  to  consider.  Then  select  as  node  3  one 
whose  net  star  constraint  is  now  violated  (the  net  stars  changing  as  new 
nodes  are  selected),  and  now  solve  (P)  as  defined  by  E2,  E3,  and  all  remaining 
edges.  Repeat  this  process  until  no  net  star  constraint  is  violated.  Note  that 
the  net  star  selected  at  each  step  may  be  determined  according  to  some 
measure  of  constraint  violation. 

At  each  iteration  the  state  digraph  is  obtained  by  splitting  a  node,  say 
vk,  into  two  new  nodes.  Using  D(vk)  for  each  new  node  guarantees 
nonnegative  reduced  costs,  so  that  the  Fredman  Tarjan  algorithm  can  be  used 
to  solve  the  resulting  minimum  weight  dipath  problems.  These  observations 
also  provide  an  alternative  solution  method  for  the  general  matroid  problem 
in  which  the  sets  Ej  are  fixed  beforehand.  Using  the  above  technique,  these 


sets  can  be  incorporated  successively  into  the  solution  in  any  chosen 
sequence.  We  note  that  the  complexity  bounds  for  this  procedure  are  the 
same  as  the  bounds  for  the  procedures  that  consider  all  sets  simultaneously. 
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